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(54) Camera control syetem 



(57) A camera control systenn having a plurality of 
camgras connected to a network, enabling users to be 
Inlormed of such as status of use o1 each camera and 
each user's access right in a real-time manner. The sys- 



tem, where one of cameras controllable via the network 
Is selected and video-display of output from the selected 
carr^era and operation of ths camera are control Idd, has 
camera-statue display device for real-time displaying 
the statuses of at least two cameras. 
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Ddftcrlptlon 

BACKGROUND OF THE INVENTION 

Present Invention relates to a camera control sys- 
tQnn and, mors particularly to a oamera conlrol syfitem 
that allows a single or plurality ot users to remote-oper- 
ate a plurality of cameras. 

A video transmission system which enables video 
transmission or Dommunlcation by video and audio 
transmission between arbitrary Uvo (ornnore) points, by 
constructing a network by arranging a number of cam- 
eras and computers in a building or the like, has been 
proposed. 

In this system, the user at an arbitrary point can re- 
mota-oparate an arbitrary camera from the point, and/ 
or display a video image from the camera on the display 
of a computer at the point. 

In the video transmission system enabling this re- 
mote-opdration of an arbitrary camara, as tha number 
of the cameras to be operated increases, it is necessary 
to easily know positions of the reapective cameras. 

General ly» in a video conference using a plurality of 
computers connected via a network, there are a plurality 
of video cameras and a plurality of users who remote- 
openatQ the video cameras. Only one user can operate 
one camera at one instant. In this case, operation prior- 
ity must be sxcl usively assigned to the user by a control 
method or standard The camera to be operated i^, e. 
g., identified by a unique name or numeral. 

However, in the conventional art, when a user wants 
to operate a camera, since thero is no means for con- 
firming whether or not the camera is actually in control- 
lable status (i.e., any other user is not currently operat- 
ing the camera, and the user has the operation right), 
the user merely hasto try to remote -ope rate the camera. 

Further, in the conventional art, there is no function 
for indicating status o1 use o1 each camera and its ac- 
cess right (right to see video Images and operate them) 
by real time. This functbn is indispensable especially 
for thfi syfitem administrator, and is also helpful to the 
other users. 

SUIVIf\/IARY OF THE INVENTION 

The present invention has been made in consider- 
ation of th3 above situation, and is concemed with pro- 
viding a camera control system which provides informa- 
tion on status of use of each camera and lis access right 
in a real-lime manner. 

Another concern of the present invention is to pro- 
vide a camera control system which reflect change of 
hardwar^e construction such as arrangement of cameras 
by simple operation by a user. 

An embodiment ot the present Invention provides a 
camera control system which Informs status of use and 
each user's access right by each camera In a real-time 
manner. 



According to a first aspect of the present invention, 
there ie provided a camera control system for selaating 
one of a plurality of controllable cameras connected to 
a network, and lor conirolling video display, comprising 

& camera-status display means for real-time displaying 
statuses of at least two of the cameras. 

Further, accordlngto a second aspect of the present 
invention, there is provided a camera control eyetem for 
selecting one of a plurality of controllable cameras con- 

fo nected to a network, and for controlling video display 
and camera parameters, comprising: layout-display 
means; symbol-display means for displaying one or 
more camera symbols representing the cameras, over 
a layout displayed on the layout-display means; and 

?5 change means for interactively .changing the camera 
symbol, In accordance with change of initial setting ot 
the system. 

Further, according to a third aapscl ot the present 
invention there is prtavided a camera control system for 

so selecting one ot a plunality d controllable cameras con- 
nected to a network, and for controlling video display 
and the camera, comprising: layout-display means; 
symbol-display means for displaying one or more cam- 
era symbols representing the cameras, over a layout 

2S displayed on the layout-display means; and change -re- 
flection means for on-line reflecting change of initial set- 
ting of the system by one of a plurality of users, on the 
layout and the camera symbol on a display screen of 
another user. 

^0 Other features and advantages besides those dis- 
cussed above shall be apparent to those skilled In the 
art from the description of a preferred smbodiment of 
the invention which follows, in the description, reference 
is made to accompanying drawings, which torm a part 

^ thereof, and which Illustrate an example otthe invention. 
Such example, however, is not exhaustive of the various 
embodiments of the invention, and therefore reference 
is made to the claims which tollow the description for 
determining the scope of the Invention. 

40 

BRIEF DESCRIPTION) OF THE DHAWINGS 

The accompanying drawings, which are incorporat- 
ed in and constitute a part of the specification, illustrate 
■^^ embodiments of the Invention andv together with the de- 
scription, serve to explain the principles of the invention. 

Fig. 1 Is a block diagram showing the basic con- 
struction of a computer system according to an em- 
^0 bodiment of the present invention; 

Fig. 2 is a block diagram showing the hardware 
structure of the embodiment in a network; 
Fig. 3 is a block diagram showing the software In- 
terface of the embodiment in the network; 
^ Fig. 4 Is a table showing the structure of a camera 
initial-setting file; 

Fig. 5 is an example of a camera display and control 
panel displayed by a carrwra control client 72 on 
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monitors BO and 62; 

Fig. 6 Is an example of a display image of an iritiai- 
settlng editor 74: 

Fig. 7 Is a flowchart showing the operation of the 
initial-setting editor 74 corresponding to Fig. 6; 
Fig. B is anothar axampls of th© camera display and 
control panel; 

Fig. 9 is an example of layout information; 
Fig. 10 is an example of camera initial-setting infor- 
mation; 

Fig. 11 \s another example of a display Image of the 
inltial-sdtting editor 74; 

Fig. 12 is allowchart showing the operation of the 
Inltlal-sotting editor 74 corresponding to Fig. 1t; 
Fig. 1 3 is a flowchart showing a procedure to vali- 
data system changa without rsstarting the systsnn; 
Fig. 14 is a block diagram showing the software 
structure in a network^ for real-time management o1 
cameras; 

Fig. 15 id an dxampiG of a first image for the real- 
time camera management; 
Fig. 1 6 is an example of statuses of cameras 1or the 
real-lime camera management; 
Fig. 17 is a flowchart showing a software starting 
procedure for the real-time camera management; 
Fig. 18 is an example of camera initial-setting Infor- 
mation of the second embodiment; 
Fig. 19 is en example of camera management in- 
formation for the real-time camera management, 
Fig. 20 is an explanatory view showing notification 
information for the real-time camera management; 
Fig. 2T id a block diagram showing a notification 
procedure for the real-time camera management; 
Fig. 22 is an example of a display image for the real- 
time camera management; 
Fig. 23 is a flowchart showing camera-information 
update processing; and 

Fig, 24 is an explanatory view of camera access as- 
signment data. 

DETAILED DEfiCRIPTION OF THE PREFERRED 
ElVlBODIMENT 

Preferred embodiment of the present invention will 
now be described in detail In accordance with the ac- 
companying drawings. 

Fig. 1 is a block diagram showing the construction 
of a computer system according to an embodiment of 
the present Invention, connected to a plurality of cam- 
eras as basic elements in the embodiment. A plurality 
of computers having the construction in Fig. 1 and a plu- 
rality of computers having a similar construction to Fig. 
1 are mutually connected via a computer network. 

In Fig. 1, reference numerals 10-1 to 10-3 denote 
video cameras; 12-1 to 12-3, camera controllers for di- 
rectly controlling panning, tilting, zooming, focus adjust- 
ment and focal-length adjustment, in accordance with 
external camera-control signals; and 1 4, a camera input 



selector for selecting one of the video cameras 10 and 
inputting the output eignal(6) from the selected camera 
(normally a video signal, but in case of e video camera 
with a microphone, a video signal and an audio signal. 
£ In this embodiment, the output signal is described only 
as a video signal). A selection line signal from the cam- 
era input selector 1 4 is. e.g., RS-232C and the like, how- 
ever, the present invention ie not limited to this line sig- 
nal. 

IvJumaral 20 denotes a camera operation unit, com- 
prising a computer system for controlling desired one of 
the camera controllers 1 2 by sending control commands 
to the camera controller 1 2 via the camera input selector 
14; 22, a CPU for controlling the overall system; 24, a 
'5 main memory; 26, a secondary memory (e.g., a hard 
disk drive]; 2d, a mouse as a pointing device; and 30, a 
keyboard. 

Numeral 22 denotes an I/O port, connected to the 
camera input selector 14, for supplying the camera con- 
trol signals and the like to the camera input selector 14; 
34, a video board for inputting an output video signal 
from a video camera 10 selected by the camera input 
selector 14 and displaying various video images on a 
bitmapdisplay 35; 36, a networklnterfacefor connecting 
the camera operation unit 20 to the computer network 
or a communication line net; and 3B, a system bue for 
mutually connecting the respective devices, from the 
CPU 22 to the network interface 36. The camera control 
signals from remote places are inputted via the network 
interface 36 to the camera operation unit 20, thus con- 
trolling the cameras 10. 

The camera input selector 14 selects one of the 
control signal lines connected to the plurality of camera 
controllers 12 and one of video outputs, then supplies 
the selected video output to the video board 34, and log- 
ically connects the selected control signal line to the 1/ 
O port 32. Ae a format of the video signal, a luminance- 
difference separation type NTSC signal is known. The 
video board 34 Inputs the video output eelected by the 
camera input selector 14. The Input video signal is dis- 
played as a moving-image in a predetermined window 
of the bitmap display 35, otherwise it is transmitted to 
another device. 

The secondary memor/ 28 holds various informa- 
tion on the cameras 10. e.g.. camera position Informa- 
tion, camera parameter data and the like. The detailed 
contents of the information will be described later 

In a case where only one camera 10 can be con- 
nectedj the camera Input selector 14 can be omitted. In 
this case, the I/O port 32 is directly connected to the 
camera controller 12. In a case where video images are 
not transmitted, the cameras 10, the camera controllers 
12 and the camera Input selector 14 can be omitted. 

The computersystemae shown in Fig. 1 is connect- 
ed Into a network as shown in Fig. 2. A terminal A has 
the construction in Fig. 1. Ataterminal B, only one cam- 
era is connected, therefore the camera controller is di- 
rectly connected to the I/O port. At a terminal C, no carrv 
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era is connsctDd. QGnsnallv* an actual network includes 
various types of tQiminals such as ths terminals A to C. 
Note that ths network of the present embodimant \s a 
LAN or a WAN having a transmission band width suffi- 
cient for transmitting digital moving-image data and 
camera control signals. 

The video board 34 has video-capture function to 
supply inpul video dala nd only to the bitmap display 
35 for image display but also to the CPU 22 via the bus 
38. The CPU 22 arranges the data into packets and out- 
puts the packets to the network via the network interface 
36. Also a camera operation command, a camera 
switchover command and the like are packeted and 
transmlned onto the network. Further, Information on the 
overall system is packeted and transmitted onto the net- 
work. These packet data are transmitted to a specified 
transmission destination or to all the terminals, in ac- 
cordance with the date contents and necessity. 

Regarding data reception, similar processing is per- 
formed. That is, whan the packeted video data, camera 
operation command and camera switchover command 
are received, the respective terminals A to C handles 
the received video data In a similar manner to that han- 
dling the internal capture data, and also handles the re- 
ceived camera operation command and camera switch- 
over command in a similar manner to that handling the 
internal commands. The information on the overall sys- 
tem is used to update display of system status to be de- 
scribed later. 

Fig. 3 is a block diagram showing the software in- 
terface of the present embodiment. Fig. 3 separately 
shows software (server] to be installed into a temiinal 
to which a camera is directly connected, and software 
(client) to be installed into terminals for remote-operat- 
ing iho camera. In general praotloe, the server and the 
client are both installed into one terminal. 

In Fig. 3, workstations 50, 52, 54 and 56 are con- 
nected to a network 57. A camera 58. corresponding a 
camera 10 In Fig. 1 , Is connected to the work station 50; 
and monitors 60 and 82, corresponding to a bitmap dis- 
play 35 in Fig. 1, rsspectively to the work stations 52 
and 54. Though described In detail later, the workstation 
56 manages camera(s) remat©<iperable via the net- 
work, access right and status of use tor each user. 

The work siailon 60 oomalns a video transmitter/ 
receiver (software) 64 for transmitting image information 
(moving image), obtained by the camera 5B» to the other 
work stations via the network 57, and a camera control 
server (software) 66 for controlling the camera 58 In ac- 
cordance with camera control signals from the worksta- 
tions 52 and 54. 

A camera management server (software) SB is in- 
stalled in the work station 56. Upon activating the cam- 
era 58, the camera control server 66 reads a camera 
Initial-setting tile, comprising of Information as shown In 
Fig. 4, from the secondary memory (26 in Fig. 1)» and 
reports to the camera management server 66, the 
names or numbers of ell the cameras and their initial 



j.tatu6B65(ttneir-pGat^6jgiQ^i §ljirec^ ■ 
<=ua6):GW3^^ectia^ta^f^f^iaT^ 
<:t7:tfloapBro.ept-SjeF^.e |a6a.-r.efl}stera:th^^ 
^camWrllist^ae-atvaitii^ 

6 The work stations 52 and 54 respectively hold a vid- 
eo tranBmitter/recGiver (sottware) 70 for receiving imag- 
es (moving Images) from the workstation SO and display 
the images on the monitors 60 and 62, a camera control 
client (software) 72 1or displaying the status of the cam- 

to era (58), displaying a camera display andoperation pan- 
el and processing the operation of the camera instructed 
by ueing the camera operation panel, and a inrtlal-^et- 
tlng editor (software) 74 for editing the initial settings of 
the camera control system, 

^5 The users of the work stations 52 and 54 can refer 
to, write into, and correct various informations managed 
by the camera management server 6B, using the cam- 
sra control clients 72. The details of these operations 
will be described later Note that when the camera man- 
so agement server 68 allows connection between a cam- 
era of another workstation, i.e., camera 58 and the work 
station 50, the camera control client 72 can transmit a 
camera control signal to the workstation 60 (the camera 
control server 65) without the camera management 

25 server 68. 

In general practice, each work station is usually 
connected to a monitor and a camera, therefore, the 
both video transmitters/receivers 64 and 70 have both 
video transmission and reception functione. Generally, 

5e software comprises of a single program or a set of pro- 
gram modules. The terminals A and C in Fig. 2 has the 
work stations 50 and 52 or 54; and the terminal B» the 
work station 52 or 54. The work station 56 in Fig. 3 may 
be part of the terminal A, B or C in Fig. 2. 

35 The camera management server 6B Is software tor 
managing the cameras, all or partially released to the 
network 57, used in, e.g., a video conference. The cam- 
era management sen/er 68, holding information on the 
names of all the cameras, their positions, ^\mMt!(&^^h 
stat.us.BSiof;uis9, p'B'rfsrmglfieflistratip^J o j^cq^^^^ of 
th 6AcarneiB"JoMh6 ir?retwof?k^57f,a g d^^^^^ 
t r attonnigi^diB cgni n e.ct jc^^ ^feeicameraifrDip ntj^^^ 
57, maBagesnacGess^llS^anSf/rSjeiotio^^^ 
i^quiwnen^ notifies 

^ camera Information to all the camera control clients 72 
via the network 57. 

In Fig. 3, the camera management server 68 is in- 
stalled In the dedicated workstation, however, it may be 
Installed In anyof the workstations (50^52 and 54) con- 

so nected to the network 57. Otherwise, the camera man- 
agement server GB may be pre-in&talled in all the work 
stations to be connected to the network, so that the cam- 
era management sen/er 6S Is activated at a workstation 
that starts the video conference. 

55 Fig. 6 shows an example of the camera display and 
control panel displayed by ths camera control client 72 
on the monrtore 60 and 62. The camera control client 72 
generates an image of the camera display and control 
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panel. Ths camera display and control panel includes a 
layout window 80 where camera loons Indlcatlva ot the 
positions and directions of the respective cameras are 
overlaid on a layout «howlng places of cameras^ a cam- 
era video-image window 84 showing a video Image ob- ^ 
talnod by a current feieoted camera, a camera opera- 
tion panel 66 comprising varloue camera control but- 
tons, and a current value display window 8B showing 
parameter values of the currently selected camera The 
camera control client 72 dieplaye the camera display JO 
and control panel on the monitors 60 and 62. In the em- 
bodiment, it l6 assumed that a window display system 
capable d simultaneously displaying a plurality of win- 
dows Is employed. In the layout window 60. a layout 
showing desks of the staff of an office and the like is 
displayed, and camera icons 82-1 to B2-6 respectively 
indicating the camera positions are displayed over the 
layout. The camera icons 62-T to &2-6 are displayed in 
directions substantially the same as those of corre- 
sponding cameras. ^o 

In the video-image window 64, an output video im- 
age from the selected camera la displayed. Note that on 
the layout window 80, to identity the selected camera, 
the camera icon corresponding to the selected camera 
is displayed in a color different from that of the other 
camera icons corresponding to unselecled cameras. 

The operation panel 86 is displayed below the cam- 
era video-image window 64. The operation panel 66 has 
rotation butone for panning and tilting, and two buttons 
for zooming. By manipulating these buttons, rotation 50 
and/or zooming of an arbftrar/ selected camera can be 
made. In a case where the selected camera is not op- 
erable, the display statue of the rotation buttons and the 
zoom buttons changes into another display status indic- 
ative of Inoperable status o! the camera. In the current 35 
value display window 88, the current values (position, 
pan-angle, lilt-angle and zoom value) of the selected 
camera are displayed. 

For example, a user who wants to access (remote- 
operate] a camera double-clicks a camera Icon indicat- 
Ing the target camera. In correspondence with the op- 
eration, the camera control client 72 requires the cam- 
era management server 68 for access right of the cam- 
era. lf4tnercSfri&i#iPSBFiS^§^;the:Gaf^^ 
inri.ent:server-6a"a*llows^ei^n«e^0i}'e?atl^^ ^ 
displayj'of - th^'ca'meraLWt^^ 
currentiyo g^ratesthe ^ 
^ion^^ Wti^PFBTe'S^^ 
'^o^lSlS^j^ ythe'c^ 
tVideo-!maige-WiritldW"B4rthu 
-rDg^sera:opBraticn3panel:8Sj(panning;-ti|^ 
c:ing)^ean"&e^macle. 

In the embodiment, addition of a new camera, re- 
moval, movement, and direction change of any of the 
cameras can be reflected In the Initial-setting file by us- ^ 
Ing the Initial-setting editor 74. 

Fig. 6 shows an example of the display image of the 
inrtial-eetting editor 74. Fig. 7 shows the operation flow- 



chart corresponding to Fig. 6. In Fig. B, the respective 
elements have reference numerals corresponding to 
operations at the respective steps in Fig. 7. The initial- 
selling editor 74 may be activated by the camera control 
client 70, or may be activated independently 

Upon activation of the initial^etting editor 74, it 
reads a camera Inltlal-settingtl le as shown in Fig. 4 (St), 
displays a camera arrangement ae shown in Fig. 6 (S2), 
and proceeds to an event waiting loop (S3). The con- 
tents ot the camera initial-setting file are maintained as 
a camera initial-setting list. In the initial-setting editor 74. 

Referring to Fig. the display image includes a lay- 
out part 90 and a command icon part 92. In the layout 
part 90, similar to the layout window 60 of the camera 
display and control panel (Fig. S], camera icons are dis- 
played over the layout. The respective camera icons are 
provided at the positions and directions of the cameras 
registered In the initial-setting file. In the command icon 
part d2, a new icon 92-1 showing a new camera icon 
94-1 to be added, a deletion icon 92-2 for deleting an 
existing camera, and an end icon 92-3 for terminating 
the initial-setting editor 74 are displayed. 

When any event occurs In the event-waiting loop, 
whether or not it requires processing is determined [S4, 
Si 0, 81 7 and S22), and any of processings appropriate 
to the event is performed. 

Next, a case where a camera is newly provided will 
be described. In this case, the user moves a mouse cur- 
sor onto the new camera icon 92-1 and press the mouse 
28 (84). The initial-SBtting editor 74 generates the new 
camera Icon 94-1 as shown in Fig. 6 and displays the 
icon in the new camera Icon 92-1. The user moves the 
mouse cursor selecting the camera icon 94-f to a de- 
sired position (SS), and releases the button of the mouse 
(SB). That Is, the user drags the camera Icon 94-1 to the 
desired position by using the mouse. If the position 
where the mouse button is released is outside of the lay- 
out area {37), the process returns to the event-waiting 
loop, while II the position resides within the layout area 
(87), a dialog 36 for Inputting a name of the new camera 
is displayed (88] . 

Thus, the setting position and the name or number 
of the new camera are given, and they are added to the 
camera initisl-setting list (S9]. 

In a case where an existing camera Is moved or re- 
moved, the following operation is made. The user se- 
lects the camera icon of the camera to ha moved or re- 
moved, 94-2 in Fig. S (810), and In case of movement, 
drags the selected Icon toa desired desilnation position, 
or in case of deletion, drags the selected icon to the de- 
letion icon 92-2 (611), and releases the mouse button 
(812). If the position where the mouse button Is released 
resides within the layout area (S13), the camera position 
on the camera initial setting list is updated with the po- 
sition as a new position o! the camera 94-2 (514). If the 
position resides outside of the layout area (S13) and on 
the deletion Icon 92-2 (S 1 5), the information on the cam- 
era 94-2 is deleted from the camera initial setting list 
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(ST6). Thai is, all the informatiofi on thG camera 94-2 ie 
deletsd from the camera initial setting iiet. If tho position 
where the mouse button is rsieased outside of the layout 
aroa (SI 3) and not on the deletion loon 92-2 (St 6), the 
selected camera icon is moved to the initial position, and 
the process returns to the svent-waiting loop. 

In a case where the initial direction o1 a carriera is 
changed, the following operation ie made. The ueer po- 
sitions the mouse cursor around the camera icon (within 
a pradatermined radius of the canter of tha camsra icon) 
indicating the camera, and press the mouse button 
(St 7). In correspondence with tho pressing of the 
mouse button, the initial-setting editor 74 displays a dot- 
tQd-llna arrow 9B extendstrom the center of the camera 
iconaiongthe initial direction (St9). The direction of the 
arrow SB indicates a pan angle, and the length, a tilt an- 
gle. The user changes the direction and the length of 
the arrow 96 by moving the mouse cursor with pressing 
the mouse button. When the arrow 9d has a desired di- 
rection and a desired length, the user rdieasds the 
mouse button [S20). The changed direction and length 
are new initial values of pan angle and tilt angle. Then, 
the contents of the camera direction information in the 
camera initial-setting list are updated (S21). 

When the user wants totermlnatethe camera initial- 
setting editor 74, the user moves the mouse cursor onto 
the end icon 92-3, and ciiclca the mou^e button (S22). 
In correspondence with the click, the camera initial-set- 
ting editor 74 updates the camera initial-setting file with 
the information on the camera initial setting list held in 
the program {S23). 

Thereafter, when the entire eyetem is restarted, the 
changes are reflected on the camera c?ontrol server 66, 
the camera management server66 and the camera con- 
trol clients 72 through steps SB, S14. St6 and S21. In 
this manner, the user can visually and interactively gen- 
erate the Initial-getting file indicating the camera ar- 
rangement and can update the file by using the initial- 
setting editor 74. 

In consideration of a case where a number of cam- 
eras are provided at remote places, e.g., in sepanate 
rooms or on separate floors, it is preferable that a plu- 
rality of layouts can be handled. For this purpose, func- 
tion for layout selection may be added to the camera 
display and control panel displayed by the camera con- 
trol client 72 on the monitors 60 and 62. Fig. 8 shows 
an example of the camera display and control panel in 
this case. In Fig. B, the elements corresponding to those 
In Fig. 5 have the sanne reference numerals. Numeral 
B9 denotes a layout list window for displaying a plurality 
of layouts. In this window, a ealectad one of the layouts 
is displayed in the layout window 80 with the camera 
icons Indicating the cameras provided there. This layout 
list window may be replaced with a menu at the top of 
the panel Image or a floating pallet. 

The information on the plurality of layouts is stored 
in, e.g., the camera management een/er 6B» and upon 
activation of the camera control client 72, It receives the 



camera initial-setting information and the information on 
a necessary layout from the camera management san/- 
sr 68. The plurality of layouts are managed, e.g., in a 
layout management file as shown In Fig. 9. The layout 

^ management file has layout numbers (ID), floor num- 
bers, bitmap file names and bitmap sizes. This layout 
management file is held in th e workstation 5S where the 
camera management server 68 exists. Upon activation 
ofthe camera management server 68, rt reads the layout 

^0 management file and stores it within the server The lay- 
out management file and the layout data are transferred 
to th© camera control clients 72 In accordance with ne- 
cessity. 

Further, It Is necessary to add Items to the layouts 

7^ where the cameras are provided corresponding to the 
respective cameras to the camera list managed by the 
camera management server 68. Aleo, it is necessary to 
add the information on the layouts where the cameras 
are provided corresponding to the respective cameras 

so to the camera in rtial-setting Information held as the cam- 
era initial-setting file, as shown in Fig. 1 0. On the camera 
display control panel, only the cameras provided on the 
layout displayed in the layout window 80 are objects to 
selection and operation. 

2S Furthermore, in consideration of addition, it is pref- 
erable to add function tor adding and deleting iayouls to 
the initial-setting editor 74, deletion and movement of 
camera(s). Fig. 11 showsthedlsplay image of the Initial- 
setting editor 74 where its function is expanded. In Fig. 

50 11 , in a layout part TOO, similar to the layout part 90 in 
Fig. 6, a layout (selected from the layout list) is dis- 
play 9d» and camera icons corresponding to the cameras 
provided there are displayed over the layout. In a com- 
mand icon part 102, an new icon 102-1 for adding a new 

^ camera, a new Icon 102-2 lor adding a new layout, a 
layout list window 102-3, a deletion icon 102-4 for de- 
leting camera icon(s) and a layout and an end icon 102-5 
for terminating the initial-setting editor 74. 

Fig. 12 is a flowchart showing the operation of the 

^0 initial-setting edrtor 74 with the expanded function. Note 
that the operations of camera icon, are identical to stepe 
&4 to S21 in Fig. 7, enclosed with a broken line, there- 
fore the operations are represented as step S34 in Fig. 
12 and the explanation of those steps will be omitted. 

First, the layout management tile and the camera 
initial-setting file stored in the fomnats shown in Figs. 9 
and 10 are read [831 }, and the camera arrangement as 
shown in Fig. 8 is displayed based on the read informa- 
tion (S^2)^ then the process enters an event-waiting 

^0 loop (S93). Notethat the contentsof the layout manage- 
ment file and the camera initial-setting file are respec- 
tively stored in the camera management server 88 as a 
layout list and a camera initial setting list. 

When any event occurs in the event-waiting loop, 

^ whether or not It requires processing Is determined 
(S34, S35, S38 and S45), and any of processings ap- 
propriate to the event is performed. 

In the event-waiting loop, when the user clicks the 
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new icon 102-2 with the inouBQ {S35), a dialog 104 is 
displayed for inputting layout information such as the 
name of a layout to be added and a bitmap file name 
(S36). Wien th$ Input has been completed, iMe Input 
inlormation on the new layout is added to the layout list 
stored in the camera managameni server SB, and the 
updated layout list Is displayed in a layout list window 
102-3 (S37). Thus, the added new layout can be eelect- 
ed on the layout list window 102-3. 

In the svenl-waiting loop, when the mouse curfior 
is on any of the layouts displayed In the layout list win- 
dow 102-3, if tha user presses the mouse button {838), 
the process advances to updating of displayed layout or 
delation ot layout. It the user releases the nnouse button 
immsdiateiy, the operation is regarded as a click 
than the layout displayed In tha layout part 100 is 
changed to the layout selected on the layout list window 
102-3 (S4C). If the user moves the mouse cursor while 
pressing the mouse button (£39), the layout selected on 
tha layout list window 102-3 is moved with the move- 
ment (drag) of the mouse cursor (S41). If the user re- 
leases the mouse button on the deletion icon 102-4 (S42 
and S43), the layout is deleted from the layout list win- 
dow 102-3 (344). To avoid erroneous deletion, a dialog 
for coniirming the layout to be deleted is displayed, and 
after the user's confirmation, tha selected layout is de- 
leted from the layout list window 102-3^ then the infor- 
mation on the selected layout is deleted from the layout 
list, and at the game time, the information on the camera 
(s) provided on the displayed layout is deleted. If the 
user releases the mouse button outside of the deletion 
Icon 102-4 (S43), the process returns to the event -wait- 
ing loop. 

When the mouse cursor is positioned on the end 
Icon 1 02-5, If the user presses the mouse button (S45), 
the contents of tha initial-setting are saved In the initial- 
setting file, and the program terminates (S46) The initial- 
setting contents are saved as the information on the lay- 
outs as shown In Fig. 9. and the Information on the cam- 
eras as shown in Fig. 10, in the initial-setting file. To val- 
idate the updated information, the entire system must 
be restarted. 

When change of initial settings is made, to validate 
the updated initial-setting information without restarting 
the system, the content of the change may be Informed 
to the camera management server 6B so that the cam- 
era management server 6B notrties the camera control 
clients 72 of the change. Fig. 1 3 shows the notification 
procedure. 

Fig. 13 shows the procedure of interactive notifica- 
tion of updated system initial settings among the initlal- 
settlng editor 74, the camera control server 66, the cam- 
era management server 66 and the camera control cli- 
ents 72 via communication through the network. 

First, as described In Fig. t2.the Initial-setting editor 
74 writes the updated initial setting information into the 
camera initial-setting file and the layout information file 
(S51). The camera initial-setting file may be saved by 



each camera control client 72 or may be saved as one 
system Hie. Further, save area may be in the secondary 
memory of any terminal connected to the network, how- 
ever, normally In the secondary memory ot the terminal 
f where the camera management server 68 is held. 

Tha initial-setting editor 74 notifies the change of 
the initial settings to the camera control server 66 on the 
terminal connected to the camera {there may be a plu- 
rality d camera control servers) and terminates (S52). 
fo The notification is performed in accordance with, e.g., 
RPC (Remote Procedure Call) or TCP/iP based socket 
communlcalion procedure. Note that any ofther mslhod 
can be employed. Similarly, the following communica- 
tion between processes may be performed In accord- 
JS anca with any method and it Is not limited to one method. 
Tha camera management server 68 receives the 
notification of change of initial settings, then reads the 
layout management file and updates the interna! layout 
list (S56), On the other hand, the camera control server 
66 reads tha camera initial-setting file (SS3), and if a 
new camera has been connected under its own control, 
tries to activate the newly-connected camera (S54). If 
the activation is successful, the camera control server 
66 informs the camera management server SB for new 
registration (S55). In a case where the camera's power 
is not turned on, the activation fails. I n this case, tha new 
registration on this camera is not made in the camera 
management server 6S. If the position (and/or direction) 
of an existing camera is changed, the camera control 
server 66 that controls the camera notifies the camera 
management server 6B of re-registration of the new po- 
sition (and/or direction) (S55). 

The camera management server 68 receives the re- 
quirement of registration or re-registration from the cam- 
era control server 56, and updates the Information on 
the initial settings of the camera list (S57>. Thereafter, 
the camera control server 66 notifies all the camera con- 
trol clients 72 o1 the change of the system, and transmits 
Information on the new initial settings (S58). 

Tha camera control client 72 receives the notifica- 
tion ot the change of tha system, and updates display 
based on the received initial setting information (860). 

In this manner, the changed initial settings can be 
validated without stopping and restarting the system. 

As It can be easily understood from the above de- 
scription, according to the present embodiment, the us- 
er can easily change camera arrangement and a layout 
to be used. In such change operations, operability is im- 
proved by using ihe simple user imerface. 

Further, the resuits d changing the initial settings 
can be automatically reflected on the display ot tha cam- 
era control client without stopping ths system. 

Next, real-lime management of statuses of camer- 
as connected to the network will be described. Note that 
as shown In Fig. 14, the real-time camera management 
can be performed without the initial-setting editor 74 
shown in Fig. 3. Accordingly, the following description 
will be made with reference to Fig. 14. 
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Fig. 16 showfi an BxamplD of the camera display 
and control panel displayed by the oannera control client 
72 on the monitors 60 and 62. The camara control client 
72 generaies an Image of the camera dl6play and con- 
trol panel. The camera display and control panel in- 
cludds a camera video-image window 110 showing a 
video image obtained by the current selected camera, 
a camera operation panel 112 comprising varioue cam- 
era control buttons, and a camera status list window 114 
showing the statuses of the camoras. The camera con- 
trol client 72 displays the camera display and control 
panel on ths monitore SO and 62. 

Fig. 1 6 shows an example of the contents displayed 
In the camera status list window 114. In the camera sta- 
tus list window 114, camera names, positions, pan an- 
glag, Hit angles, zacm values and statuses of use of all 
the available cameras connected to the network 57 are 
displayed. The camera names are unique names to 
identify the respective cameras; positions, three-dimen- 
sional coordinates indicating points where the cameras 
are appropriately provided; and pan angles and Hit an- 
gles, image-Lansing distances. The statuses of use in- 
dicate a user who currently has access right When one 
camera is not used by an user, the corresponding cell 
of the statuses of use is blank, otherwise "NOBODY" is 
displayed. 

For exemple, when a user wants to access (remote- 
operate) to one of the cameras, the user selects (by e. 
g., double-click of the mouse) the desired camera on the 
camera list displayed in the camera status list window 
1 1 4. If there Is no user accessed to the camera, the cam- 
era management server 6B allows the user to remote- 
operate the camera (including display of video Images), 
while If there already Is another user operating the cam- 
era» the camera management sopi/er 6B allows only to 
display the video image from the camera. As the video- 
image display is allowed, the output image from the 
camera is displayed in the camera video-image window 
110. Whan the remote operation Is allowed, operation 
(panning, tilting and zooming) by using the camera op- 
eration panel 112 becomes possible. 

Next, the procedure of real-time updating and dis- 
playing the camera directions will be described. First, 
software activation procedure will be described with ref- 
erence 10 Fig. 17. The camera management sen/er 68 
is activated earlier than all the other softwares and waits 
for connection of cameras (S101). 

Next, the video transmitter/receiver 64 and the cam- 
era control server 66 on the same work station are ac- 
tivated (S102 and Si 03). Upon activation, ths camera 
control server 65 reads the camera inrtial-satting tile, 
and notifies the camera management server 68 of the 
cameranames and the initial slaluses of all the cameras 
connected to the same work station. The information, 
Including camera names/numbers, floor numbers, cam- 
era positions (x-, y- and ^-coordinates), initial attitudes 
(pan angle and tilt angle) as shown in Fig. 1B and the 
like, is stored in the secondary memory. 



The camera management server 68 receives the in- 
formation on the connected cameras from the camera 
control sen/er 66, and registers the initial statuses of the 
cameras into Its own camera management table as 
shown In Fig. 19. In Fig. 19, the camera management 
table shows camera namsa/n umbers, connacfted work 
stations (hosts), statuses of use (unused(blank)yu3er 
name), initialstatuees (x-, y- and z-coordinatee and pan- 
hsad parameters such as pan angles and tilt angles) 
fo and dynamic statuses (camera head angles based on 
panhead parameters and zoom values). 

Naxt,the video transmitter/receiver 64andthe cam- 
era control server 66 are activated on all the computers 
which are to transmit video Images to the network 67. 

In a computer which is to operate another compu- 
ter's camera via the network 57, the video transmitter/ 
receiver 70 and the camera control client 72 are activat- 
ed. Note that in a computer which is only to receive video 
images from another computer, only the video transmit- 
tsr/recsiver 70 is activated. Upon activation of the cam- 
era control client 72, it receives the information on all 
the cameras available via the networks? from the cam- 
era management server 68, and displays the informa- 
tion as ths camera list in the camera status list window 
25 114. Thus, the users of computers, where the camera 
control clients 72 are activated, can know the staluses 
of ell the cameras. 

It there is change of the inlormation on the statuses 
of all the cameras via the network 57, the camera man- 
30 agement server 66 notifies the computers holding the 
camera control clients 72 of thechange periodically. The 
computers input the change information and updates 
the camera Net in the camera status list window 1t4. 

Next, the operation of notifying system information 
^ by the camera management sen/er 66 will be described. 
The system information is as shown in Fig. 20. Note that 
Fig. 20 shows only a part of the information managed 
by ths camsra management sen/er 66. Since upon ac- 
tivation of the camera control client 72, It receives all the 
information including the camera initial-setting infomna- 
tion from the camera management server 68, rt only re- 
ceives dynamically changing information. Fig. 20 gives 
as the object of notification, information assisting the 
camera control client 72 to detect all the available cam- 
^ eras or camera access Intormatlon (operation of the 
camera management sen/er). In addition to items (cam- 
era parameters such as pan angles, tilt angles and zoom 
values) changed In correspondence with user's camera 
control. 

50 The notification procedure will be briefly described 
with reference to Fig. 21. The camera management 
server 63 requires one camera control sen/er 66 to ob- 
tain camera parameters of the corresponding camera. 
The camera control server 66 performs communication 

^ with a camera control circuit to obtain the camera pa- 
rameters, and returns the obtained camera parameters 
to the camera management sen/er 68. After confirming 
the response, the camera management server 68 com- 
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nnandfi another camera control fiarver 66 for camera pa- 
rameters of the corresponding camera, in this manner, 
tine camera managemant server 66 obtains tlis camera 
parameters from all the camera controi servers 66 on 
tins system, Thereafter, tine camera management server 
Be generates the syetam Information as shown in Fig. 
20» and notifies all the camera control clients 72 of the 
information ae the system information via the network 
57. 

After the activation of the camera control client 72, 
It aiwaya monitors the buffer of a channel on which the 
sydtem information \& inputted via the network interface 
36. Whsn there \8 any input in the buffer, the camera 
controi client 72 reads the Input as notification Informa- 
tion, and in accordance with necessity, updates the 
camera Wst ad follows. 

If it is found that a new camera has been added to 
the system, the camera control client 72 informs the 
camera management server 68 for the camera initial - 
setting infomiation. Then, the camsra control client 72 
adds the obtained camera initial-setting information and 
the notification information, and displays the information 
on the camera list. If it is found that a camera has bean 
removed from the system, the camera control client 72 
deletes the Information on the removed camera from the 
camera list. 

If there has been change(9) in camera access sta- 
tuses, the camera control client 72 updates the content 
of the 6tatu6 of use of the corresponding camera in the 
camera list. 

In this manner, the users, who are to remote-oper- 
ate via the network 36 the camera of another computer 
connected to the networl^ 36, can always know the cur- 
rent status of the entire system, and can know in ad- 
vance whether or not a desired camera is available. 

In this example, the information on all the cameras 
is displayed in the camera status list window 1 14» how- 
ever, it is not clear as to the position and direction of the 
respective cameras or a camera selected by the user 

This problem can be solved by using a user Inter- 
face as shown In Fig. 22. 

In Fig. 22, it is assumed that a window display sys- 
tem capable of simultaneouely displaying a plurality of 
windows is employed. In a layout window 1 40, a layout 
showing desks of the stafi of an office and the like is 
displayed, and camera icons 1 42-1 to 1 42-7 respective- 
ly indicating the camera positions are displayed over the 
layout. The camera icons 142-1 to 142-7 are displayed 
in directions substantially the same as those of corre- 
sponding cameras. 

In video-image window 144, an output video image 
from a selected camera Is displayed. Note that on the 
layout window 140, to identify the ealeded camera, the 
camera icon corresponding to the selected camera is 
displayed In a color different from that of the other cam- 
era Icons corresponding to unselected cameras. 

An operation panel 1 46 is displayed below the cam- 
era video-image window 144. The operation panel 146 



has rotation buttons for panning and lilting, and siiding- 
type buttons for zooming. By manipulating these but- 
tons, rotation and/or zooming of an arbitrary selected 
camera can be made, in a case where the selected cam- 
^ era is not operable, the display status of the rotation but- 
tons and the zoom buttons changes into display status 
indicative of inoperable status of the camsra. In a cur- 
rent value display window 148, the current values (po- 
sition, pan-angle, tilt-angle and zoom value) of the se- 
fo lected camera are displayed. 

Next, the display of the notification information from 
the camera management server 68 whan the user inter- 
face in Fig. 22 is employed will be described with refer- 
ence to Fig. 23. 

After the activation of the camera control client 72, 
it always monitors the buffer of the channel on which the 
system information is inputted via the network interface 
36 (Si 11 ). When there is any input in the buffer, tha cam- 
sra control client 72 reads the input as notification infor- 
mation, and operates as follows in accordance with ne- 
cessity. 

11 it is found that tho system construction has been 
changed (S112), e.g., a new camera has been added to 
the system, the camera control citeni 72 requires the 
camera management server 68 for the camera initial- 
setting information (SI T3). Then, the camera control cli- 
ent 72 adds the obtained camera initial-setting infomia- 
tion and the notification information, and displays the in- 
formation on the layout window 140 (3114 and S1 15). 

if it is found that a camera has been removed from 
the system, the camera control client 72 deletes the in- 
formation on tha removed camera from the camera list, 
and deletes the corresponding camera icon on the lay- 
out window 140. 

It new camera access has started or camera access 
has ended (3116), the camera control client 72 updates 
the display of the corresponding camera on the camera 
window 140 (S114). The camera control client 72 held 
In each computerdlsplays three types of cameras, cam- 
era(s] accessed by the user of the computer, camera(s) 
accessed by another user and Ltnaccessed camera(&), 
indifferent display statuses, e.g., different display colors 
for easy visual discrimination. 

11 rt is found that the camera-access direction of a 
currently displayed camera has been changed (S1t7), 
the camera control client 72 changes the information on 
the direction and displays the information again (S118 
andS119). 

The camera management server 6B can manages 
access right of the cameras. The access right is right to 
remote ope rate a desired camera. The camera manage- 
ment server 68 has a tabia of access information for 
each camera, as shown in Fig. 24 When a user requires 
access to a camera, the camera management server 68 
confirms whether or not the user has acquired the ac- 
cess right to the camera, and if the user has the access 
right and no other user can use (remote-operates) 1he 
camera, allows the user to operate the camera. 
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Tho accGfifi right is not fiXGd, but the ownsre of re- 
Bp active cameras Of an authorized system manager can 
change the content or ievel ot the access right, in such 
caso, an access-right change button may be provided 
on the camera operation panei solhat the owner or sys- 
tem manager can aliow an arbitrary user to access the 
camera connected to the own woric station, otherwise 
cancel the aiiowance. 

To notify the users of the accessibility status of the 
camaras. B.g.» camera ioon(s) of accBSSiblQ DamQra(a) 
and camera lcon(s) of inaccessible camera(9) may be 
displayed In different chroma or iightnesfi values. This 
display method to change representation of gradation 
or color difference is well-known. 

As described above, as the notification information 
of the camera management server 68 includes access- 
right information, even when the access right informa- 
tion of a camera is changed by another user, the 
changed result can be displayed immediately for all the 
users, 

As it is explained in the above description, in a case 
where a plurality of cameras are control led by a plurality 
of users, all the users can obtain the information on the 
entire system in a real time manner Further, visual dis- 
play provides a Inturtivs user interface. 

The present invention is not limited to the above em- 
bodiments and various changes and modifications can 
be made within the spirit and scope of the present in- 
vention. Therefore, to apprise the public of the scope of 
the present invention, the following claims are made. 



Claims 

1 . A camera control system for selecting one ot a plu- 
rality of controllable cameras connected to a net- 
work, and for controlling video display, comprising 
camera-status display means for real-time display- 
ing statuses of at least two of the cameras. 

2. The camera control system according to claim 1 , 
further comprising; 

layout-display means; and 
symbol-display means for displaying camera 
symbols representing the plurality of cameras 
over a layout displayed on said layout-display 
means, 

wtierein said symbcl-dlsplay means displays 
one or more current statuses of predetermined 
features o1 the cameras with the camera sym- 
bols. 

3. The camera control system according to claim 1, 
wherein said camera-siatusdisplay moansdlsplays 
connection and disconnection of the cameras to the 
network, and start and end of use. paramelers and 
available or unavailable status of use of one con- 



nected camera. 

4. The camera control system according to claim 3, 
wherein when a user desires to use one of the cam- 
eras, if the camera is used by ancrther user, said 
symbol-display means displays the symbol of the 
camera in a color different from that of the other 
cameras. 

fo S. The camera control system according to claim 3, 
wherein said camera-status display means displays 
a pan angle by a direction of a camera symbol. 

6. The camera control system according to claim 3, 
?5 wherein ff registration of a new camera is informed 

on the system, said symbol-display means displays 
a camera symbol of the new camera on the layout, 
while if a camera is disconnected, said symbol-dis- 
play means deletes the camera symbol of the cam- 
so era on the layout. 

7. The camera control system according to claim 2, 
wherein said symbol-display means displays a 
symbol of an unavailable camera so as to indicate 

2S responseless status. 

a. The camera control system according to claim 1 , 
further comprising: 

50 camera control means for controlling the cam- 

eras; and 

management means for managing the statuses 
of the cameras, 

wherein said camera control means notifies 
^ said management means of the statuses of the 

cameras. 

The camera control system according to claim 8, 
wherein said camera control means notifies the sta- 
40 tuses of the cameras in accordance with instruction 
from said management means. 

10, The camera control system according to claim 9, 
wherein said camera-status display means displays 
the statuses of the cameras In accordance with In- 
formation outputted by said management means. 

1 1 . A camera control system for selectin g one ot a plu- 
rality of ccnirollable cameras connected to a net- 

so work, and for controlling video display and camera 
parameters, comprising: 

layout-display means; 

symbol-display means for displaying one or 
^ more camera symbols representing the camer- 

as, over a layout displayed on said layout-dis- 
play means; and 

change means for interactively changing the 
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camera symbol, in accordance with change of 
initial setting of eaid system. 

12. The canfiera control system according lo clainn 1t, 
wherein change of the camera symbol by said * 
change means is addition, deletion and changing of 
position and direction of the camera symbol. 

13. The camera control systsm according to claim n, 
further comprising layout-Information change fo 
means for interactively changing the layout dis- 
played on said layout -display maane. 

14. The camera control system according to claim 13^ 
wherein said layout-information change means in- 
teractivetyadds anddeletee the layout displayed on 
said layout-display means. 

1 6. A camera control system for selecting one of a plu- 
rality Off controllable cameras connected to a net- so 
work, and for controlling video display and the cam- 
era, comprising: 

layout-display means; 

symbol-display means for displaying one or 2$ 
more camera symbols representing the camer- 
as, over a layout displayed on said layout-dis- 
play means; and 

cliange-reflection means for on-line reflecting 
change of initial setting of said system by one 
of a plurality of users, on the layout and the 
camera symbol on a display screen of another 
user. 
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FIG. 3 
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